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Description 

BACKGROUND OF THE INVENTION 

5 The invention relates to a method and system for processing data relating to the performance of 
apparatus having a number of distinct components in order to estimate both changes in the performance of 
the individual components making up the apparatus and biasses or systematic errors in a measurement 
system being used to determine the performance of the apparatus and its components. It has particular 
relevance to analysing the performance of gas turbines, although it has more general applications to a wide 

10 variety of apparatus including machines, particularly prime movers and other rotary machines, and plant, 
such as chemical process plant, generating and distribution plant, etc. 

Monitoring the performance of such machines and plant can yield important data on maintenance 
requirements to achieve safe, economical and reliable operation. It is particularly important in such 
circumstances to determine both which components of the machine or plant being monitored have deviated 

75 from their required performance specifications and which measurements being used for monitoring have 
developed systematic errors, in order to refurbish or replace only those components which have deterio- 
rated and refurbish, replace or recalibrate faulty measuring equipment that, because of the presence of 
systematic errors, is producing spurious indications. 

It is important to note that the overall performance of any apparatus made up of a number of 

20 components is completely determined by the performance of such components. For example, in a gas 
turbine, overall performance measurements such as fuel consumption, speed, exhaust temperature, etc. are 
determined by component performance parameters such as efficiency, flow capacity, etc. Generally, 
changes in one or more component performance parameters will cause changes in one or more overall 
performance measurements, and it is only possible to alter overall performance measurements by altering 

25 one or more component performance parameters. Thus, it is only possible to improve the fuel consumption 
of a gas turbine by altering the efficiency and/or flow capacity of one or more of its components. Naturally, 
some apparent changes in overall performance may be caused, not by component performance changes, 
but by biasses in the measurements used to determine the overall performance. The problem exists, 
therefore, to be able to assess, from an analysis of changes in performance measurements, both the 

30 component performance parameters that have changed and the biasses in the measurements. 

To assist the engineer in this task, recent years have seen the introduction of computer-based 
performance data analysis systems, particularly in the field of gas turbines. From the preceding comments 
it can be appreciated that any analysis has to be performed using a number of known data items (i.e. 
performance measurements) which is generally less than the number of unknown data items (i.e. compo- 

35 nent performance parameter changes and sensor biasses). There is therefore no single true solution set of 
component performance parameter changes and sensor biasses to be derived from a particular set of 
performance measurement data, and techniques are required that derive the most likely solution. In 
particular, so-called Optimal Estimation or Kalman Filtering computation techniques have been used to 
analyse gas turbine performance data (see, for example, "Gas Path Analysis applied to Turbine Engine 

40 Condition Monitoring", L.A. Urban, AIAA 72-1082 (1973) and "Gas Path Analysis: An Approach to Engine 
Diagnostics", Dr A.J.VoIponi, 35th Mechanical Failures Prevention Group (1982)). The basic theory behind 
Kalman Filtering is also well known (see, for example, "Digital and Kalman Filtering", S.M. Bozic, Pub E 
Arnold (1984); "Applied Optimal Estimation", A Gelb (ed), Pub MIT Press (1974); "Applied Optimal 
Control", A.E.Bryson and Y.C.Ho, Pub Halstead Press (1975); "System Identification". P.Eykhoff. Pub Wiley 

45 (1974)). 

The Kalman Filter is an algorithm for producing, from given data, the most likely solution, based on the 
method of least squares. Stated in its simplest form it may be seen as a weighting matrix (sometimes 
termed the Kalman Gain Matrix) which inter-relates a-priori information (specifically a covariance matrix of 
component changes and sensor biasses, a measurement repeatability covariance matrix and a System 

so Matrix, ie a matrix giving the relationships between observed measurement changes and component 
changes and sensor biasses) to enable the most likely set of component changes and sensor biasses to be 
calculated from the observed performance measurement changes. 

The Kalman Filter algorithm is thus given a set of observed performance measurement changes. Each 
of these changes represents the change in value of a parameter from a datum level (at which there are no 

55 component changes or sensor biasses to be taken into account) to an operational level (which has been 
affected by such changes and biasses). The algorithm calculates which set of component performance 
changes and sensor biasses is most likely to have caused the given set of observed performance 
measurement changes, using information described in the preceding paragraph. 
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An inherent shortcoming of the Kalman Filter is that, because it operates on the basis of least squares, 
it tends to allocate a value to all possible component changes and sensor brasses, even if the observed 
performance measurement changes input to the filter are due to only a small sub-set of the possible 
component changes and sensor biasses. The effects of any genuine component performance changes 

5 and/or sensor biasses therefore tend to be "smeared" over all possible component changes and sensor 
biasses, leading to under-estimation of actual component changes and/or sensor biasses which may have 
occurred in any particular situation. 

In the extensive literature describing the use of the Kalman Filter for the analysis of apparatus 
(particularly gas turbines), this problem is either ignored or is addressed in one of four different ways, 

io namely: 

a) the problem is alleviated, but not eliminated, by adjustment of the a-priori matrices used to calculate 
the Kalman Gain Matrix, 

b) other algorithms are run after the Kalman Filter which assume the presence of a single component 
change or sensor bias; these algorithms are activated if the results from the Kalman Filter exceed certain 

15 thresholds, 

c) searches are made for sensor biases using separate algorithms run before and/or after the Kalman 
filter, 

d) "banks" of Kalman filters are set up to analyse a given piece of apparatus: each filter in such a bank 
is set up to analyse a different combination of component changes and sensor biases, while other 

20 algorithms are used to decide which filter is correct in any given situation. 

Patent no. US-A-4215412 (Bernier et a!.) provides an instance of the use of Kalman filtering in 
performance monitoring, in which the above problem seems to be ignored. The patent is concerned with 
digital processing of sensor data to make predictions of values of gas turbine engine performance 
parameters which are indicative of performance deterioration. Values of actual and predicted performance 

25 parameters are compared to derive deviation signals which are supplied to monitoring logic. The monitoring 
logic uses the deviation signals to indicate faults within the digital processor, the sensors and the engine 
and to determine trends in the performance parameters. Specifically, Kalman filtering is used to determine 
the values of certain performance related coefficients distinctive of the particular gas turbine engine whose 
performance is being monitored. It is also used to derive performance trend coefficients whose current 

30 values reflect long-term changes in the monitored performance parameters. 

On the other hand, Patent Abstract of Japan Band 9, No.6 (P-326) 11.1.85 appears to provide an 
example of strategy (b), described above, whereas Patent Abstract of Japan Band 8, No.269 (P-319) 8.12.84 
seems to be an example of the above strategy (c). 

The above approaches are unsatisfactory because they either work within the restrictions of the Kalman 

35 filter without solving the basic "smearing" tendency, or rely on gross assumptions about the number and/or 
combinations and/or magnitudes of component changes and/or sensor biases, which may not always be 
correct. 

SUMMARY OF THE INVENTION 

40 

The invention provides a method for processing data relating to the performance of an apparatus, the 
apparatus including a plurality of components whose individual performances affect the performance of the 
apparatus and a plurality of sensors for giving inputs to a performance measurement system, the inputs 
from the sensors being subject to biases which produce errors in the measured performance of the 
45 apparatus, the method involving determination of changes in component performance and magnitude of 
sensor biases from a series of performance measurements, the method comprising the steps of: 

a) defining a-priori information required by a Kalman filter, comprising 

i) a covariance matrix of component performance measurement changes and sensor biases, 

ii) a measurement non-repeatability covariance matrix, 

60 jjj) a system matrix which provides relationships between observed performance measurement 

changes and sensor biases; 

b) using the performance measurement system to obtain datum levels of the performance measurements 
from the apparatus; 

c) using the performance measurement system to obtain performance measurements from the appara- 
55 tus; 

d) using data obtained in steps (b) and (c) to derive performance measurement differences from datum 
levels; 
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e) using data obtained in steps (a) and (d) to derive a most likely set of component performance changes 
and sensor biases by employing a Kalman filter; the method being characterised by the further steps of 

f) evaluating an objective function giving a measure of the amount of unexplained performance 
measurement change and/or the amounts of component performance measurement change and sensor 

5 bias in the solution from (e), 

g) discarding one or more of the component performance changes and/or sensor biases, to leave one or 
more of said component changes and/or sensor biases for evaluation; 

h) repeating steps (e) to (g), if required, until the total number of component performance changes and 
sensor biases remaining is one; and 

10 i) considering sets of estimated component performance changes and sensor biases produced in each 
repeat of step (e), together with the corresponding objective function evaluated according to step (0, to 
identify as a best result that repeat of step (e) which has produced a minimum number of component 
performance changes and sensor biases that satisfactorily account for the calculated performance 
measurement differences. 

15 In the performance of the method for processing data, the reiteration of steps (e) to (g) produces a 
sequence of vectors of component performance changes and sensor biases which account for the observed 
performance measurement differences, each successive vector containing progressively reducing numbers 
of component performance changes and sensor biases. The selection of an appropriate result is made by 
using the objective function, worked out for each vector in step (f) above. One method of working out such 

20 an objective function is to derive the sum of squares of the unexplained measurement changes, weighted 
according to the measurement repeatability covariance matrix. This gives a value which has a chi-square 
distribution, with as many degrees of freedom as there are performance measurements to be analysed. 

In the the final result from step (i), above, the selected best answer is preferably refined by discarding 
those elements whose values (expressed e.g. either in absolute terms or as a number of standard 

25 deviations) are less than a predetermined lower level, in order to eliminate minor component changes and 
sensor biasses that can be safely ignored or that may be present in the answer as a residual "smearing" 
effect. 

As a preferred basis for the rejection process in step (g), the estimated component changes and sensor 
biasses can be normalised by dividing the individual estimated component changes and sensor biasses by 
. 30 the square roots of the corresponding diagonal elements of the a-posteriori covariance matrix produced as 
output from the Kalman Filter. 

To select the elements to be discarded in step (h), a preferred method on the first pass is to evaluate • 
the average amount of absolute normalized change (i.e. with sign removed) and then discard all elements 
whose absolute normalized change is below that average. For subsequent passes, all component changes 
35 and/or sensor biasses whose absolute values of normalized change are less than the previous pass are 
discarded; however, in each pass provision must be made to reject at least one component change or bias 
(usually the one having the smallest absolute value of normalized change) and to retain at least one 
component change or sensor bias (usually the one having the largest absolute value of normalized change). 

When establishing the System Matrix, the effects of changes in the components of the apparatus under 
40 investigation on the measurements used to determine the performance of the apparatus and its components 
must be determined. Care should be exercised to ensure that suitable measurements are taken that 
respond in distinct ways to the component changes being sought. 

GAS TURBINE ANALYSIS 

45 

In the example of a gas turbine analysis, the component changes may involve changes in seal 
clearances, the presence of foreign matter in particular locations, the opening of gas leakage paths, etc. 
These can each be related to one or more component performance parameter changes. A list of these 
related changes can be drawn up, as in the following example. 



55 
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Component Changes 
turbine tip seal rubs 

5 

nozzJe guide vane platform seal 
to gaps; blocked nozzle guide vane 
cooling holes 

15 

compressor blade tip erosion; 
dirt on compressor blades; 
20 damage by foreign object 



Performance Parameter Changes 
turbine efficiency changes 

turbine capacity changes; 
cooling air changes 

compressor efficiency changes 



25 



35 



mis-shapen final nozzle nozzle discharge and velocity 

coefficient changes 



30 seal gap increases cooling air changes 



air offtake pipe leaks environmental control system 

bleed changes 



40 The causes of a change in engine performance can accordingly be expressed as a series of component 

performance parameter changes. Thus, for example: 

fan tip efficiency and capacity changes 

fan root/booster efficiency and capacity changes 

core compressor efficiency and capacity changes 
45 turbine efficiency and capacity changes 

combustion chamber pressure loss changes 

by-pass duct pressure loss changes 

nozzle discharge and velocity coefficient changes 

cooling/sealing air flow changes 
50 environmental control system bleed and power offtake changes 

These changes will each affect overall engine performance parameters such as cruise specific fuel 

consumption, take-off turbine exhaust temperature, compressor working line levels, etc. The purpose of the 

performance measurements made is to enable resolution of the causes of such overall performance 

parameter changes, by identification of the individual component performance parameter changes that 
55 caused them. 

Few if any of the component performance parameter changes can be directly measured in practice. 
Moreover, the measurement instrumentation available in a production engine will be extremely limited as 
compared with a fully instrumented engine in a test rig. The typical performance measurements that may 
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be available are: 
shaft speeds 
fuel flow 
(test-bed) thrust 

5 total inlet air flow (itself derived from total and static pressure measurements and total temperature) 

total and/or static pressures in the engine gas path - through either single or multiple taps in that 

path 

total and/or "static" temperatures in the engine gas path (the former through single or multiple taps and 
the latter through wall-mounted transducers) 

w a power level parameter, e.g. exhaust pressure ratio or output shaft torque. 

After establishing the list of possible component performance parameter changes and the list of available 
performance measurements, a component exchange rate table is generated showing the percentage 
change in each performance measurement for a small change of each component performance parameter 
(e.g, a 1% change, or a unit change if the datum value is zero) at the operational conditions, i.e. the flight 

15 conditions and power level, at which the analysis is to be performed. 

FURTHER GENERAL FACTORS IN THE ANALYSIS PROCESS 

Also to be considered in the analysis of the performance of apparatus such as a gas turbine are 

20 environmental parameters, since environmental changes can alter the engine performance. Measurements 
are therefore required defining the environmental conditions. Depending upon whether the analysis is being 
performed in flight or on a test-bed these should include altitude, Mach No, total air temperature (flight), cell 
pressure and air intake temperature (test-bed), and preferably appropriate measurements for humidity 
determination. With these there must always be one performance measurement from the preceding table 

25 before any form of analysis can begin: this measurement is used to define the power level. 

It will normally also be required to include the effects of environmental and power level measurement 
sensor bias in the analysis, for which it is necessary to calculate the effects of small (e.g., 1%) biasses in 
flight conditions and power-setting parameter measurements, these having been assumed fixed when 
establishing the component exchange rate table. This is done by calculating the percentage changes in the 

30 performance measurements if the flight condition and power level measurements are changed by a 
negative increment, to create the environmental exchange rate table. (The choice of the negative sign is 
because a positive bias, i.e., a higher reading than the actual value, will produce apparently depressed 
performance measurements). 

The effects of performance measurement sensor bias on the analysis can be included by generating a 

35 further matrix. This can be formulated essentially as a matrix which states that a sensor bias (e.g., 1%) in a 
performance measurement produces a corresponding change in that measurement while leaving all the 
other measurements unaffected. If sensor bias is considered possible in all the measurements, this matrix is 
an identify matrix. 

A combined matrix, which is here termed the System Matrix, can then be created by concatenating the 
40 component exchange rate table, the environmental exchange rate table and the performance measurement 
sensor bias matrix. 

A further factor which it is usually necessary to consider is the random error that exists in all 
measurement systems. That is to say, the degree of accuracy of any measurement is not represented 
solely by sensor biasses; there will also be uncertainty due to random variations caused by many small 

45 effects which lead to differences in repeated measurements of a given quantity. This error source is 
referred to here as repeatability. Random variations will also occur in the environmental and power level 
measurements, introducing further repeatability factors. It can be assumed, if bias is accounted for 
separately, that these random variations will have the well-known normal distribution. To take account of 
repeatability, it is therefore necessary to determine standard deviations for the repeatabilities of the 

so environmental and power level measurements. The analysis must give due weight to the repeatability of all 
the measurements. 

The measurement repeatability standard deviations can be determined either by dedicated testing of 
the measurement system, in which the statistical properties of the measurement system are calculated from 
the output generated by known input signals, or from previous experience of either the system being used 
55 or of similar systems in use elsewhere. 

The standard deviations of component change and sensor bias can be determined by a variety of 
methods, for example by the analysis of data taken from a large "family" of nominally identical pieces of 
apparatus of the type being analysed, or by making an informed assessment using experience and 
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judgement, perhaps refined by studying the response of the Kalrnan Filter to performance measurement 
changes corresponding to known component changes and sensor biasses. 

DETAILED DESCRIPTION OF AN ANALYTICAL PROCESS 

5 

To establish the Kalrnan Filter, the following input is required: 

a) component exchange rate and environmental exchange rate tables, as discussed above, which are 
used to produce the System Matrix; these tables contain the established relationships between compo- 
nent changes and performance measurements and the changes in performance measurements due to 

w environmental and power level measurement errors, 

b) a set of expected levels of performance measurements at the flight conditions and power level at 
which the analysis is to be performed for a datum engine - i.e. an engine with performance at some 
desired level with which other engines can be compared; since the best estimates of component 
changes and sensor biasses produced by the Kalrnan Filter will be relative to this datum, it follows that 

ts the datum engine component changes and sensor biasses are all zero: in the performance analysis, 
percentage differences between observed and expected levels of performance measurements will be 
input into the Kalrnan Filter to produce the desired best estimates of component changes and sensor 
biasses that produced those differences, 

c) a set of standard deviations of the repeatability in the performance measurements, flight condition 
20 measurements and power level measurements from which the a-priori measurement non-repeatability 

covariance matrix is calculated, 

d) a set of standard deviations in the component changes and sensor biasses about their normal (usually 
zero) levels: these are used to create the a-priori component change and sensor bias covariance matrix, 
usually (but not necessarily limited to) a diagonal matrix containing the squares of these standard 

25 deviations. 

Considering the concept of the Kalrnan Filter, the basic equation defining the analysis being undertaken 
and which forms a starting point for the Kalrnan Filter is 

y = C * x + y 

30 

in which: 

y = (m * 1) column vector of differences between observed and expected levels of performance 
measurements 

C = (m * n) System Matrix, as described above, defining the effect on the performance measurements 
35 of given changes in component performance parameters, environmental and power level measurement 
sensor biasses and performance measurement sensor biasses 

x = (n * 1) column vector of changes in component performance parameters and sensor biasses 
v = (m * 1) column vector of noise terms in the performance measurement differences - assumed to be 
normally distributed, with a mean zero and a known covariance R. 
40 It can be seen that the equation states the relationship between the performance measurement 
differences from expectation and the component changes and sensor biasses that generated them. The 
noise terms represent a degree of corruption of the performance measurement differences due to random 
errors in the measurement system. 

As has already been explained, since the number of terms (n) in x is usually considerably greater than 
45 the number of terms (m) in y, there is no unique solution that identifies which term or terms in x has 
generated a change in y. Ail that is possible by mathematical analysis is a "best estimate", i.e. a solution 
expressed as the most likely vector of component changes and sensor biasses that has generated an 
observed vector of performance measurement differences. Through the algorithm known as the Kalrnan 
Filter that estimate can be generated, 
so The Kalrnan Filter can be expressed in the following group of equations: 

x = x 0 + K - (y -C * x 0 ) 

K = Q*C T -(C # Q.C T + R)~ 1 

FN = (I - K-C)*Q 

55 

where 

x = (n . 1) column vector of best estimates of component changes and sensor biasses after 

performance measurement differences from expectation are observed 
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10 



5 



y 

K 
C 



Q 
Pi 



= (n - 1) column vector of best estimates of component changes and sensor biasses before 
performance measurement differences from expectation are observed. This vector is usually 
zero; in this case x = K • y 

= (m . 1) column vector of performance measurement differences from expectation 
= (n • m) Kalman Gain Matrix 

= (m . n) System Matrix, relating performance measurement differences to component changes 
and sensor biasses 

= (n * n) a-priori covariance matrix of component changes and sensor biasses 

= (n - n) a-posteriori covariance matrix of best estimates of component changes and sensor 

biasses 



Superscript T denotes matrix transpose 
Superscript -1 denotes matrix inversion 
I denotes unit matrix of appropriate dimensions 

R = (m * m) a-priori measurement repeatability covariance matrix, 
75 which can be established in the form 

R = C * V * C ,T 



20 V = (t • t) diagonal matrix of squares of standard deviations of repeatabilities, where t = number of 
environmental measurements plus number of performance measurements 
C = (m * t) matrix which contains both the environmental exchange rate table and a unit matrix 
concatenated together 

The R matrix therefore contains the variances and covariances of the apparent repeatability in the 

25 performance measurement differences, arising from both repeatability in the observed performance mea- 
surements and the repeatability in the expected performance measurements that is a consequence of 
repeatability in the flight condition and power-level measurements that define the levels of expected 
performance measurements. 

For a detailed derivation of the Kalman Filter equations, reference can be made to "Applied Optimal 

30 Estimation", A Gelb, M.l.T. Press 1974. The equations denote that K is proportional to the uncertainty in the 
estimation x and is inversely proportional to the uncertainty in the measurements y; K weights the changes 
made to x Q to produce x depending upon the relative certainty of y and x. 

The use of prior information about expected levels of component changes and sensor biasses, 
uncertainties in both the expected levels of component changes and sensor biasses and uncertainties in the 

35 measurements relies upon the judgement of the skilled observer. That is to say, if there is no uncertainty 
about the mathematical relation between variables but considerations of repeatability indicate a large 
uncertainty in the measurements, the best estimate of the relationship will not be affected by measurements 
that do not conform to the established mathematical relationship. On the other hand if the relationship is 
uncertain and measurement repeatability is considered to be give negligible uncertainty, the best estimate 

40 of the relationship will be determined to a large extent by the measurements. 

Generally, there is insufficient data available in the first instance for an adequate statistical analysis of 
these factors. From practical considerations, therefore, the values in the Q matrix are at least initially 
selected by the judgement of the user. To obtain a measure of how appropriate are the values chosen, in 
an initial processing of the input data it is possible to produce (by forming the product K * C) the set of 

45 vectors of best estimates of component performance changes and sensor biasses for performance 
measurement differences appropriate to a unit change of each component change or sensor bias in turn 
and to examine the results to see whether, for a specific change in the performance of a component or the 
bias of a sensor, there is an unwanted confusion of the sought-for change or bias with the other changes 
and biasses included. Should this be observed, the Q matrix can be modified to reduce the possible 

50 confusion to a minimum. 

In an ideal case, the product (K . C) would be a unit matrix; confusion between the different parameters 
gives the diagonals of the matrix values less than unity, as well as non-zero off-diagonal elements. A 
preferred method of refining the Q matrix relies on first normalising the (K . C) matrix by dividing each row 
by the corresponding diagonal element of the Pi matrix. In the normalised matrix, the values in each 

55 column are then divided by the diagonal element of that column so as to produce a matrix in which ail the 
diagonal elements are unity; this last step is performed primarily to aid recognition of the relative sizes of 
these diagonal elements to the other values of their column vector. 



in which 
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in making the comparison, the user will want to ensure that no ratio should be greater than unity, and 
that the number of ratios greater than 0.6, other than the diagonal element itself, should be minimised. The 
aim is that, for any column, the number of ratios greater than the average of the absolute values of all the 
ratios should be minimised. One way of doing this is to use an algorithm such as the Downhill Simplex 
5 Method (Nelder and Mead page 308, Computer Journal, Vol 7, 1965) to adjust the component change and 
sensor bias standard deviations, (i.e the square root of the diagonal elements of the Q matrix) until the sum 
of the absolute values of the off-diagonal terms in the normalised (K • C) matrix is minimised, giving extra 
weightings if necessary to elements with absolute values greater than 0.6 and elements with absolute values 
greater than t .0. 

io If the analysis is carried out with no further refinement, however, the underlying mathematical principles, 
as already mentioned, result in all the component changes and sensor biasses being analysed as non-zero 
and give a result in which the observed performance measurement changes are attributed to all the 
possible component changes and sensor biasses that might have caused them. This introduces a 
"smearing" effect which can result in the actual component changes and sensor biasses being underes- 

15 timated. in accordance with the present invention, the result is treated so as to concentrate the estimates 
around the more significant component changes and sensor biasses that appear through the basic Kalman 
Filter analysis. This involves selectively removing individual changes and biasses while re-distributing any 
observed effects over the remaining changes and biasses until the analysis yields a result which appears 
more appropriate to the observer, for example showing that the observed performance changes can be 

20 attributed wholly or mainly to a small number of significant component changes and/or sensor baisses. 

A preferred method of carrying out this process for concentrating the attribution of the changes involves 
the following steps: 

(a) evaluate an objective function f; 

25 f = (y -C*x) T *R~ 1 . (y - C . x) 

(this gives a measure of the amount of unexplained measurement change and has a chi-square 
distribution, with the number of degrees of freedom equal to the number of performance measurements), 

(b) normalise each element of the vector x by dividing by the square root of the respective diagonal 
30 element of the Pi matrix to produce vector x n with elements given by: 

i'th element of 

£ = i'th element of £ 

-n VU'th diagonal element of FT) 

35 1 

(c) component changes and sensor biasses whose elements in x n have absolute values less than the 
average of all the absolute values of the elements in x n are removed (at least one, but not all, of the 
component changes and sensor biasses are removed in this step), 

40 (d) the Kalman Filter is re-run, including only those component changes and sensor biasses that have 
not been removed in step (c), to produce a new vector x of best estimates of component changes and 
sensor biasses, 

(e) steps (a),(b) and (d) are repeated; in each repeat those component changes and sensor biasses 
whose elements in x n which have absolute values that are lower than in the preceding run are removed, 
45 (f) the repeats of steps (a),(b) and (d) are continued until only one component change or sensor bias is 
left and the series of vectors of best estimates of component changes and sensor biasses (each with a 
different number of changes and biasses) produced by each run of the Kalman Filter are numbered 
sequentially in the order in which they were generated, 

(g) a maximum is selected for the objective function value, either empirically or by calculation from a chi- 
50 square probability distribution, the number of degrees of freedom (which is equal to the number of 

performance measurements) and a user-defined probability level: the highest-numbered x vector from 
step (f) whose corresponding objective function value is less than this maximum is selected as the "best 
answer", i.e. the selected result contains the smallest set of component changes and/or sensor biasses 
that successfully accounts for the observed performance measurement differences (if none of the 
55 objective function values are less than the maximum, the basic Kalman Filter result from the first run is 
taken as the "best answer"), 

(h) the "best answer" is further modified by rejecting component changes and sensor biasses whose 
elements in x have absolute values less than either a user-specified absolute value or a user-specified 
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absolute number of standard deviations: the user is therefore presented with the most significant set of 
estimated component changes and sensor biasses that generated the observed performance measure- 
ment differences. 

5 FURTHER DEVELOPMENTS OF THE METHOD 

The method described so far is one in which an analysis yields information based on a set of 
performance measurement differences obtained at a particular point in time. In certain situations, where the 
apparatus is being monitored over a period of time, it is possible to obtain a number of sets of performance 
70 measurement differences gathered sequentially over time. Each distinct type of performance measurement 
difference, gathered over time, can be considered as a time series in its own right, and can be processed 
using a number of well known prior art techniques, for example: 

a) moving average 

b) exponential smoothing 
;5 c) Bayesian Inferencing 

Bayesian Inferencing is the preferred method of processing time series data, since an observed time 
series can be processed to produce: 

a) level estimates, i.e. estimates of the value of a parameter in which, as far as possible, spurious 
disturbances from point to point have been removed, 
20 b) trend estimates, i.e. estimates of the rate of change of the parameter in question, 

c) differences between the observed value of the parameter in question and the value that would be 
predicted from the level and trend estimates associated with the previous point in the time series. 

Full details of this method are given in "Bayesian Forecasting", P J Harrison and C F Stevens, J Royal 
Statistical Soc., 1976 and "A Bayesian Approach to Short-Term Forecasting", P J Harrison and C F 
25 Stevens, Operational Research Quarterly, Vol 2 No 4 1971. The equations used are as follows: 

si = (Pn,k-i/r + qn/r) + 2 . (pi 2lk -i/r + Qia/r) + (p 2 2,k-i/r + q22/r) 
S2 = (Pi 2 ,k-i/r + qi2/r) + (p 22 ,k-i/r + q 22 /r) 
s 3 = (p 22l k-i/r + q22/r) 
30 Delta k = Obs k - (Levelk-i + Trendy) 

Level k = (Levels + Trends i) + (s,/(si + 1)). Delta* 
Trend k = Trend k -i + (s 2 /(si + 1))*Delta k 
Pii,k/r = si/(si + 1) 
Pi2,k/r = s 2 /(si + 1) 

35 

P22,k /r - S 3 " S 2 /(s l + » 

40 where 

qn/r, qi2/r. q22/r are the level variance, the level-trend covariance and the trend variance, each divided 
by the variance of the repeatability of the observations. 

Pu/r, pi 2 /r, p 22 /r are the level estimate variance, the level-trend estimate covariance and the trend 
estimate variance, each divided by the repeatability of the observations. 
45 Obs = observed value of parameter 

Delta = difference between observed value of parameter and value predicted from previous level and 
trend estimates 

Level = Level estimate 

Trend = Trend estimate 
so si , s 2 , S3 are defined by the above equations, and used to simplify the algebra 

subscript k denotes current point in time series 

subscript k-1 denotes previous point in time series 

All the available performance measurement differences, gathered over time, can be processed, using 
the above algorithm (or one of the other prior art techniques) to produce sets of measurement difference 
55 level estimates, trend estimates and differences between observed and predicted values ( or output 
appropriate to the other prior art techniques) corresponding to each observed set of performance measure- 
ment differences. The other prior art techniques can similarly be operated on time series data to produce 
results in accordance with their known capabilities. In the case of Bayesian Inferencing, each set of 
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measurement difference level estimates produced can be used as input in the method according to the 
invention to give estimates of component changes and/or sensor biasses that are unaffected, as far as 
possible, by spurious disturbances in the performance measurement differences. Furthermore, each set of 
measurement difference trend estimates can be used as input in the method according to the invention to 
5 give estimates of the rate of change of component changes and/or biasses, and each set of differences 
between observed and predicted measurement difference can be used as input in the method to detect 
sudden changes in the component changes and/or sensor biasses from one point to the next. If other prior 
art algorithms are used, the sets of output produced can, in a similar manner, be input to the method 
according to the invention to produce corresponding component change and/or sensor bias assessments. 

70 

EXAMPLES OF THE ANALYTICAL METHODS OF THE INVENTION 

In the further description of the invention, reference will be made to the accompanying drawings, in 
which: 

15 Fig. 1 is a schematic illustration of the analytical situation to which the invention is applied, 
Fig. 2 illustrates the System Matrix of Fig. 1, 

Fig. 3 is a diagrammatic sectional view of a single-spool gas turbine indicating the performance 
measurement sources used for an analysis of its performance by the method of the invention, and 
Fig. 4 is a flow diagram illustrating the application of the method of the invention to estimate levels and 
20 trends. 

Fig. 1 illustrates schematically the manner in which the vector x of unknown component changes and 
unknown sensor biasses produces an observed vector y of observed differences in the performance 
measurements. The changes are imposed on the apparatus, i.e. in the example under discussion this being 
the gas turbine shown in Fig. 3, and in that apparatus, the interdependence of the variables of the system 

25 give rise to performance measurement differences, the observation of which may be corrupted to some 
extent by noise or random variations (v). The relationships between component changes and sensor biasses 
and observed performance measurement changes are defined by the System Matrix C shown in Fig. 2. 
This consists of an (m * j) component exchange rate table which sets out the effects of small changes in a 
series of j component performance parameters on a series of m performance measurements at specific 

30 environmental conditions and a specific power level, an environmental exchange rate table in the form of an 
(m - k) exchange rate table setting out the effects on the m performance measurements of small changes in 
the (k-1) environmental conditions and power level, and finally a table for sensor bias, stating that a specific 
bias in a performance measurement produces a corresponding change in that measurement while leaving 
all other measurements unaffected. 

35 Fig. 3 shows a single-shaft gas turbine jet engine with a compressor section 100 immediately 
downstream of an air inlet 102 and coupled by a rotary shaft 104 to a turbine section 106 that follows a 
combustor section 108. Air is drawn through the inlet 102 into the compressor section, the compressed air 
is burnt with fuel injected into the combustor section and the hot combustion gases flow through the turbine 
section to drive the shaft 104 before exiting as a jet through an exhaust nozzle 110. The figure indicates the 

40 measurements taken during operation, in this case being those available from normal test bed instrumenta- 
tion. They consist of the inlet air flow rate (W1A), inlet total pressure (P2) and total temperature (T2), shaft 
speed (NH), compressor exit total pressure (P3) and total temperature (T3), fuel flow rate (WFE), turbine 
exit total temperature (T7) and net engine thrust (FN), this last providing a power level parameter. 

The component exchange rate table, giving the percentage change in each of these measurements for 

45 a 1% change of component performance parameter is shown in Table 1. The component performance 
parameters here are compressor efficiency (DE25) and capacity (CW25), turbine efficiency (DE4) and 
capacity (CW4), and propelling nozzle area change (A8). 

Table 2 gives the environmental exchange rate table showing the percentage change in each of the 
measurements for a 1 % bias in the thrust sensor measurement (FNS), the inlet pressure sensor measure- 
so ment (P2S) and the inlet temperature sensor measurement (T2S). 

These first two tables are concatenated with a matrix showing the effects of peformance measurement 
sensor bias to give the System Matrix shown in Table 3. The matrix of measurement biasses indicates that 
a 1% sensor bias for any measurement produces a corresponding change in that measurement but no 
others. In this example, a small simplification is obtained by assuming that there can be no bias in the shaft 

55 speed measurement. 

From experience and judgement of the equipment being used, standard deviations of the repeatability 
of the measurements from the instrumentation are produced, as shown in Table 4. From these values can 
be generated the a-priori measurement repeatability covariance matrix R shown in Table 5. The matrix is 
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symmotric and is thus defined by the lower triangular elements that have been set out. 

In Table 6 are listed standard deviations of the component performance parameters and sensor biasses 
respectively which, when squared, provide a diagonal a-priori covariance matrix Q of component changes 
and sensor biasses. 

5 From the data of the preceding tables the Kalman Gain Matrix K can be obtained, as shown in Table 7, 
for use in a first pass. This data also provides an a-posteriori covariance matrix (Pi ) of best estimates of 
component changes and sensor biasses in accordance with the assumptions of Tables 1 to 6. The test 
measurements provide a vector (y) which can then be processed with this data in accordance with the 
formulae given earlier for a first pass of the Kalman Filter. In subsequent passes a similar procedure is 

jo followed, using as a modified imput the progressively smaller number of component changes and sensor 
biasses remaining as one or more are discarded after each pass. 

To illustrate the operation of the concentration process, a simulated example will be described based on 
the engine of Fig. 3 and the data of the preceding tables, in which the analysis of a specific set of 
component performance parameter changes and sensor biasses is considered by using, as input, the 

75 performance measurement differences generated by those changes and biasses. Thus, Table 8 shows, for 
the engine, the performance measurement differences generated by a -1% change of compressor 
efficiency, a -0.5% bias in the engine thrust sensor (thrust being used as the power level parameter) and a 
+ 0.5% bias in the turbine exit temperature sensor. If these measurement changes are subjected to analysis 
by the Kalman Filter, the results obtained are as shown in Table 9. 

20 This first analysis is then subjected to the concentration process. Tables 10 and 11 give the calculations 
over a total of six runs of the Kalman Filter. Column 1 of Table 10 shows the results of the first run 
corresponding to Table 9 and Column 1 of Table 11 shows the square roots of the diagonals of the a- 
posteriori covariance matrix P\ associated with the respective component changes and sensor biasses. The 
absolute values of normalised elements of this vector of component changes and sensor biasses are 

25 determined and values less than the average are removed (see Table 12) and in the second column of 
Table 10 is shown the second run of the Kalman Filter in which these removed elements are assumed to be 
zero. 

The elements in column 2 of Tables 10 and 11, obtained following this second run of the Kalman Filter, 
indicate that one element, the engine inlet airflow sensor bias, can be eliminated for a third run of the 
30 Kalman Filter (see Table 12). Similarly, as shown in Table 12, the elements in column 3 of Tables 10 and 
1 1 , obtained following this third run of the Kalman Filter, indicate that two further elements, the change of 
turbine efficiency and the inlet temperature sensor bias, can be eliminated for a fourth run of the Kalman 
Filter. Further reiteration of the process leads to a single component performance change remaining for the 
sixth run. 

35 For each run an objective function is calculated, based on the six degrees of freedom of the system 
(the number of observed performance measurements being six). From chi-square tables with six degrees of 
freedom and an acceptable probability level of 95%, the maximum value of the objective function is 
determined as 12.6. In simple statistical terms, passes 1 and 4 might be considered the best answers 
because they give the lowest values for the objective function; however, applying the further condition that 

40 the answer should explain the performance changes in terms of the minimum number of component 
changes and sensor biasses, pass 4 of the Kalman Filter is selected as the "best answer". It will be noted 
that this result reproduces very closely the actual component changes and sensor biasses assumed at the 
outset. 

As discussed above, it is also possible to apply known techniques to a number of sets of performance 
45 measurement differences observed over a period of time to obtain smoothed values and estimate trends 
and deviations of observed values from predicted levels. The application of the Kalman Filter technique of 
concentrating the estimates of component performance changes and/or sensor biasses into a minimum 
number of such parameters, as described with reference to the preceding figures and tables, to the 
derivation of such level and trend estimates is ilustrated schematically in Fig. 4. This shows the 
50 measurement differences obtained from the engine of Fig. 3 being employed in the one instance (Block A) 
in the concentration process already described to give a "best answer" from an instantaneous set of data, 
and in the other instance (Block B) through the processing, by the known techniques, of a number of such 
sets of data collected at intervals to derive the levels and trends contained in that data. The data from Block 
B itself requires further analysis to produce an estimate of the levels and trends in the component changes 
55 and/or sensor baisses that underlie the measurement difference levels and trends produced in the process 
of Block B. For this purpose, the data output from Block B is input to a Kalman Filter in which a 
concentration process of the form already described is performed (Block C). 
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Fig. 4 indicates the different sets of data that may be derived in Block B, namely level estimates, trend 
estimates and differences (A) between observed and predicted values. Each set is subjected to analysis 
separately by a Kalman Filter with which the concentration technique is applied to give a final output which 
satisfactorily explains the data in terms of the least number of component performance changes and/or 
5 sensor biasses. 

Also indicated in Fig. 4 is the use of the basic (unconcentrated) output from the Kalman Filter (Block A) 
from a series of sets of measurement difference inputs to provide the data for the algorithms for smoothing 
and for deriving trends in the data (Block D), although generally processing in the manner shown in Blocks 
B and C will be preferred. 

w As an example of the manner in which the foregoing analysis of levels and trends operates, there will 
now be described a case in which, in a series of 20 sets of measurement readings from a gas turbine, after 
the 8th set the compressor efficiency (DE25) begins to fall at the rate of 0.2% in each succeeding reading. 
With the same sensor sources of the earlier example of tables 8-12, the measurement differences for each 
of the data sets 1-20 provides the matrix shown in Table 13. 

15 By employing this matrix in the prior art, a table of level estimates for the measurement differences is 
produced (Table 14). When this data is processed by the Kalman Filter in the reiterative manner already 
described with reference to Tables 8-12, "best answers" for the smoothed values of changes in compressor 
efficiency appear as shown in Table 15. It will be seen that, because of smoothing, when the change of 
level first occurs it is not recorded because the smoothing process indicates a change too small to be 

20 noted. When it first appears in set 11, the actual change (-0.6) is underestimated but the true value is soon 
reached (set 1 5 onwards). 

A similar pattern emerges when the trend estimates (Table 16) are input to the Kalman Filter and by the 
reiterative process the results shown in Table 17 are produced, showing a close approach to the actual 
trend from measurement set 13 onwards. 
25 From the foregoing description, it will be clear that the methods disclosed can be applied to a wide 
range of apparatus and plant if required. In the gas turbine field another application lies in test bed 
calibration; thus by running a particular engine in different test beds in turn, the differences of sensor bias in 
the two test beds, can be analysed using the method of the invention. 

30 
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TABLE 1 

COMPONENT EXCHANGE RATE TABLE 

5 





DE25 


CW25 


DE4 


CW4 


A8 


P3 


0.0510 


0.0240 


0.1380 


-0.9400 


0.4010 


T3 


-0.4240 


-0.1600 


0.2970 


-0.3820 


0.4120 


T7 


-0.9700 


-0.3630 


-0.8300 


0.3550 


-0.2390 


WFE 


-1.0190 


-0.3710 


-0.8650 


0.3770 


0.0870 


NH 


0.1010 


-0.5220 


0.5600 


-0.3170 


0.6470 


W1A 


0.5280 


0.2060 


0.4580 


-0.1860 


0.4680 



20 

TABLE 2 

ENVIRONMENTAL EXCHANGE RATE TABLE 





FNS 


P2S 


T2S 


P3 


-0.6100 


-0.4140 


0.0380 


T3 


-0.2920 


0.3520 


-0.9390 


T7 


-0.6780 


0.8360 


-0.9890 


WFE 


-1.3560 


0.5670 


-0.6460 


NH 


-0.3240 


0.4080 


-0.4600 


W1A 


-0.2840 


-0.7760 


0.5330 
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TABLE 6 

STANDARD DEVIATIONS FOR THE A-PRIORI COVARIANCE 
MATRIX OF COMPONENT CHANGES AND SENSOR BIASSES 



DE25 


0.894 


CW25 


0.950 


DE4 


0.962 


CW4 


0.642 


A8 


1.087 


FNS 


0.619 


P2S 


0.764 


T2S 


0.644 


P35 


0.568 


T35 


0.414 


T75 


0.425 


WFES 


0.589 


W1AS 


0.426 



The covariance matrix is a diagonal matrix made 
up from the squares of the above values. 
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TABLE 7 

KALMAN GAIN MATRIX ON FIRST PASS 





P3 


T3 


T7 


WFE 


NH 


W1A 


DE25 


-0.020* 


-0.0690 


0.0029 


-0.1501 


0.3770 


0.0555 


CW25 


0.0020 


0.5891 


-0.1336 


-0.0275 


-0.8070 


0.2112 


DEO 


-0.1809 


0.3103 


-0.2280 


-0.1501 


0.2518 


0.0027 


CWO 


-0.0512 


-0.1005 


0.0297 


0.1200 


0.0631 


0.2087 


A8 


-0.0103 


0.1009 


-0.0861 


0.1997 


0.0126 


0.3788 


FNS 


-0.1256 


0.1128 


-0.0880 


-0.2076 


-0.0566 


-0.2089 


P2S 


-0.1206 


-0.1390 


0.0329 


-0.0319 


0.O08O 


-0.3576 


T2S 


0.0369 


-0.3807 


-0.1700 


0.1331 


0.0736 


-0.0036 


P35 


0.0711 


-0.1032 


0.0617 


-0.0800 


-0.0080 


-0.2272 


T35 


-0.0761 


0.0203 


-0.1019 


0.0125 


-0.2679 


0.0025 


T75 


0.0305 


-0.1070 • 


0.0657 


-0.2597 


0.0078 


0.2568 


WFES 


-0.0907 


0.0250 


-0.0989 


0.0556 


-0.0202 


-0.1308 


W1AS 


-0.1278 


0.0050 


0.2580 


-0.0680 


-0.0635 


0.0260 
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TABLE 8 

Measurement Differences (y) created by -1% compressor 
efficiency, -0.5% thrust (power setting) bias and 
+0.5% turbine exit temperature bias 



Compressor exit pressure change 
Compressor exit temperature change 
Turbine exit temperature change 
Fuel flow change 
Shaft speed change 
Inlet airflow change 



<P3) 
(T3) 
(T7) 



+0.254% 
+0.570% 
+ 1.809% 



(WFE) +1.697% 
(NH) +0.061% 
(W1A) -0.386% 
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TABLE 9 

Analysis by Kalman Filter of above measurement changes 



(DE25) -0,528% + 
(CW25) -0.083% 
(DE4) -0.524% * 
-0.009% 
+0.116% 
-0.387% + 
+0.057% 
-0.293% * 



(CW4) 

(A8) 

(FNS) 

(P2S) 

(T2S) 



Compressor efficiency change 
Compressor flow capacity change 
Turbine efficiency change 
Turbine flow capacity change 
Propelling nozzle area change 
Thrust sensor bias 
Inlet pressure sensor bias 
Inlet temperature sensor bias 
Compressor exit pressure sensor 
bias 

Compressor exit temperature 
sensor bias 

Turbine exit temperature sensor 
bias 

Fuel flow sensor bias 
Inlet airflow sensor bias 
Notes 

1. Note underestimation of changes/biasses used to generate 
measurements (+), and estimation of spurious changes/biasses (significant 
values marked *) caused by "smearing". 

2. No shaft speed sensor bias is assumed to be present. 



(P3S) +0.094% 

(T3S) +0.024% 

(T7S) +0.253% + 
(WFES) -0.089% 
(W1AS) +0.175% * 
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TABLE 10 





Sequential estimates of component changes and 


sensor biasses 


Pass No. 


I 


2 3 0 


5 6 


DE25 


-0.528% 


-0.530% -0.573% -1.000% 


-1.061% -1.227% 


CW25 


-0.083% 


- 




DEO 


-0.520% 


-0.326% -0.288% 




CWO 


-0.009% 


- - - 




A8 


+0.116% 


- - - 




FNS 


-0.387% 


-0.502% -0.510% -0.087% 


_ 


P2S 


+0.057% 




- 


T2S 


-0.293% 


-0.295% -0.250% 




P3S 


+0.090% 




- 


T3S 


+0.020% 






T7S 


+0.253% 


+0.388% +0.010% +0.088% 


+0.030% 


WFES 


-0.089% 






W1AS 


+0.175% 


+0.006% 




Objective 
Function 


0.021 


0.210 0.200 0.003 


27.932 69.811 



Value 
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TABLE II 

Square roots of diagonals of P. matrix 



Pass No. 1 2 3 4 5 6 



DE25 0.68121 0.53285 0.52030 0.04418 0.04282 0.03405 

CW25 0.71771 - 

DE4 0.66073 0.35918 0.34459 

CW4 0.47459 ----- 

A8 0.75463 ----- 

FNS 0.44891 0.11166 0.10670 0.09352 

P2S 0.56342 ----- 

T2S 0.49342 0.32309 0.30037 

P3S 0.41307 - 

T3S 0.31521 ----- 

T7S 0.31066 0.13278 0.11353 0.06837 0.06759 

WFES 0.43457 ----- 

W1AS 0.32263 0.12175 - 
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TABLE 12 

Absolute values of normalized estimates of component changes and sensor 
biasses, obtained by dividing the elements in Table 10 by the elements in Table 
11, and removing sign . 

Pass No. 1 2 3 4 5 6 

DE25 0.775 

CW25 0.116 * 

DE4 0.793 

CW4 0.019 * 

A8 0.154 * 

FNS 0.862 

P2S 0.101 * 

T2S 0.594 

P3S 0.228 * 

T3S 0.076 * 

T7S 0.814 

WFES 0.205 * 

WIAS 0.542 



Average 0.406 
Notes 

1. * denotes elements rejected because they are less than the average (pass 1 
only) 

2. + denotes elements rejected because they are less than the values in the 
previous pass 

3. X denotes elements rejected because they are the lowest values in the 
current pass. 



0.995 1.101 22.725 24.778 36.035 

0.908 0.836 + 

4.496 4.817 5.207 X 

0.913 0.832 + 

2.922 3.647 7.138 6.421 X 

0.378 + 
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TABLE 13 

MEASUREMENT DIFFERENCES FOR 20 SERIAL SETS OF READINGS 





P3 


T3 


T7 


WFE 


NH 


W1A 


i 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


2 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


j 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 




0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


5 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


c 

o 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


7 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 




0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


9 


-0.010 


0.085 


0.194 


0.204 


-0.020 


-0.106 


10 


-0.020 


0.170 


0.388 


0.408 


-0.040 


-0.211 


1 1 


-0.031 


0.254 


0.582 


0.611 


-0.061 


-0.317 


12 


-0.041 


0.339 


0.776 


0.815 


-0.081 


-0.422 


13 


-0.051 


0.424 


0.970 


1.019 


-0.101 


-0.528 


I* 


-0.061 


0.509 


1.164 


1.223 


-0.121 


-0.634 


15 


-0.071 


0.594 


1.358 


1.427 


-0.141 


-0.739 


16 


-0.082 


0.678 


1.552 


1.630 


-0.162 


-0.845 


17 


-0.092 


0.763 


1.746 


1.834 


-0.182 


-0.950 


18 


-0.102 


0.848 


1.940 


2.038 


-0.202 


-1.056 


19 


-0.112 


0.933 


2.134 


2.242 


-0.222 


-1.162 


20 


-0.122 


1.018 


2.328 


2.446 


-0.242 


-1.267 



40 



45 



50 
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TABLE 10 

LEVEL ESTIMATES FOR THE MEASUREMENT DIFFERENCES 



5 



10 



75 



SET 


P3 


T3 


T7 


WFE 


NH 


W1A 


I 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


2 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


3 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


4 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


5 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


6 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


7 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


8 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


9 


-0.006 


0.007 


0.107 


0.113 


-0.011 


-0.058 


io 


-0.015 


0.123 


0.281 


0.295 


-0.029 


-0.153 


11 


-0.026 


0.213 


0.038 


0.513 


-0.051 


-0.266 


12 


-0.037 


0.310 


0.708 


0.700 


-0.070 


-0.386 


13 


-0.0*9 


0.006 


0.928 


0.975 


-0.097 


-0.505 


10 


-0.060 


0.099 


1.103 


1.200 


-0.119 


-0.622 


15 


-0.071 


0.590 


1.350 


1.018 


-0.101 


-0.735 


16 


-0.082 


0.678 


1.552 


1.630 


-0.162 


-0.805 


17 


-0.092 


0.765 


1.709 


1.838 


-0.182 


-0.952 


18 


-0.102 


0.350 


1.900 


2.002 


-0.2C2 


-1.058 


19 


-C.U2 


0.930 


2.138 


2.206 


-0.223 


-1.160 


20 


-0.123 


1.019 


2.331 


2.008 


-0.203 


-1.269 



35 



40 



45 
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TABLE 16 

TREND ESTIMATES FOR THE MEASUREMENT DIFFERENCES 

5 



>ET 


P3 


T3 


T7 


WFE 


NH 


Wl A 


1 


0.0000 


0.0000 


0.0000 


0 0000 


0 0000 


0 G0G0 

W . WW WW 


2 


0.0000 


0.0000 


0.0000 


0.0000 


0 0000 


0 0000 


3 


0.0000 


0.0000 


0.0000 


0.0000 

V. WW 


0 0000 


0 0000 




0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0 0000 




0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0 0000 




0.0000 


0.0000 


0.0000 


0.0000 


0 0000 


0 0000 


7 


0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0 0000 

v. www w 


s 


0.0000 


0.0000 


0.0000 


0.0000 


0.0000 


0 0000 

w. www w 


9 


-0.0022 


0.0179 


0.04 1 0 


0.0431 


-0.0043 


-0.0223 


10 


-0.0048 


0.0401 


0.0917 


0.0963 


-0.0095 


-0.0499 


1 i 


n nn7 1 








-w.Ul 4/ 


-U.wV *#u 


12 


-0.0088 


0.0735 


0.1680 


0.1765 


-0.0175 


-0.0915 


13 


-0.0099 


0.0821 


0.1879 


0.1973 


-0.0196 


-0.1023 


14 


-0.0 10<* 


0.0866 


0.1980 


0.0280 


-0.0206 


-0.1078 


15 


-0.0106 


0.0882 


0.2017 


0.2119 


-0.0210 


-0.1098 


16 


-0.0106 


0.0882 


0.2017 


0.2119 


-0.0210 


-0.1098 


17 


-0.0105 


0.0875 


0.2001 


0.2102 


-0.0208 


-0.1089 


IS 


-o.:io4 


0.0866 


0.1981 


0.2081 


-0.0206 


-0.1C7S 


19 


-0.0103 


0.0858 


0.1963 


0.2062 


-G.C2C4 


-C.1069 


20 


-0.0103 


0.0853 


0.1950 


0.2049 


-0.0203 


-0.1062 



35 
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Claims 

1. A method for processing data relating to the performance of an apparatus, the apparatus including a 
plurality of components whose individual performances affect the performance of the apparatus and a 
so plurality of sensors for giving inputs to a performance measurement system, the inputs from the 
sensors being subject to biases which produce errors in the measured performance of the apparatus, 
the method involving determination of changes in component performance and magnitude of sensor 
biases from a series of performance measurements, the method comprising the steps of: 
a) defining a-priori information required by a Kalman filter, comprising 
55 j) a covariance matrix of component performance measurement changes and sensor biases, 

ii) a measurement non-repeatability covariance matrix, 

iii) a system matrix which provides relationships between observed performance measurement 
changes and sensor biases; 
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b) using the performance measurement system to obtain datum levels of the performance measure- 
ments from the apparatus; 

c) using the performance measurement system to obtain performance measurements from the 
apparatus; 

5 d) using data obtained in steps (b) and (c) to derive performance measurement differences from 

datum levels; 

e) using data obtained in steps (a) and (d) to derive a most likely set of component performance 
changes and sensor biases by employing a Kalman filter; the method being characterised by the 
further steps of 

10 f) evaluating an objective function giving a measure of the amount of unexplained performance 

measurement change and/or the amounts of component performance measurement change and 
sensor bias in the solution from (e), 

g) discarding one or more of the component performance changes and/or sensor biases, to leave 
one or more of said component changes and/or sensor biases for evaluation; 
J5 h) repeating steps (e) to (g), if required, until the total number of component performance changes 

and sensor biases remaining is one; and 

i) considering sets of estimated component performance changes and sensor biases produced in 
each repeat of step (e), together with the corresponding objective function evaluated according to 
step (f). to identify as a best result that repeat of step (e) which has produced a minimum number of 
20 component performance changes and sensor biases that satisfactorily account for the calculated 

performance measurement differences. 

2. A method according to claim 1, in which the objective function is evaluated by deriving the sum of the 
squares of the unexplained performance measurement changes, weighted according to the measure- 

25 ment non-repeatability covariance matrix. 

3. A method according to claim 1 or claim 2 in which the component performance changes and sensor 
biases are normalised by dividing individual estimated component performance changes and sensor 
biases by the square roots of the corresponding diagonal elements of an a-posteriori covariance matrix 

30 produced as output from the Kalman filter. 

4. A method according to any one of claims 1 to 3 wherein, in the best result identified in step (i), 
component performance changes and/or sensor biases whose values are less than a predetermined 
lower level are discarded. 

35 

5. A method according to any one of claims 1 to 4 in which an average absolute amount of normalised 
change is evaluated after a first repeat of step (e) and provides a datum for discarding component 
performance changes and/or sensor biases prior to a second such repeat. 

40 6. A method according to any one of claims 1 to 5 in which, at the end of the second and each further 
repeat of step (e), changes in the absolute amounts of normalised change relative to the preceding 
repeat are evaluated for each of the remaining component performance changes and/or sensor biases 
and provide datums for discarding component performance changes and/or sensor biases prior to the 
next repeat. 

45 

7. A method according to claim 6 wherein component performance changes and/or sensor biases are 
discarded if they are less then their corresponding values in said previous pass, subject to at least the 
greatest said change or bias being retained and at least the smallest being discarded. 

50 8. A method according to any one of claims 1 to 7 in which a-priori values for elements of the covariance 
matrix of the component performance changes and sensor biases are estimated and a product is 
formed with (i) a Kalman Gain Matrix of the Kalman filter and (ii) the System Matrix, to evaluate a 
measure of confusion of desired component performance changes and/or sensor biases with other 
changes and/or biases due to said estimates, and said estimates are adjusted to reduce the confusion 

55 indicated by said evaluation. 

9. A method according to any one of claims 1 to 8 in which a-priori information supplied to the Kalman 
filter includes a best estimate of the effects on the matrices of at least one anticipated component 
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performance change and/or sensor bias. 

10. A method according to any preceding claim, in which a plurality of sets of performance measurements 
are obtained at intervals and employed to determine levels and/or trends and/or variations from 

5 predicted values in component performance change and/or sensor bias. 

11. A method according to claim 10, in which said sets of performance measurements are analysed for 
said levels and/or trends, and the level values and/or the trend values and/or the differences between 
observed and predicted measurements that are obtained from said analysis are then subjected to 

10 Kalman filter processing. 

12. A method according to claim 10, in which said sets of performance measurements are subjected to 
Kalman filter processing and the values obtained are then analysed for levels and/or trends and/or 
variations from predicted values of component performance change and/or sensor bias. 

J5 

Patentanspriiche 

1. Verfahren zur Verarbeitung von Daten, die sich auf den Betrieb einer Vorrichtung beziehen, die 
mehrere Komponenten aufweist, deren individuelles Betriebsverhalten den Betrieb der Vorrichtung 
20 beeinfluBt, und die mehrere Sensoren besitzt, urn einem Betriebsmeflsystem Eingange zu liefern, wobei 
die Eingange von den Sensoren Fehlern unterworfen sind, die Fehler in dem gemessenen Betriebsver- 
halten der Vorrichtung erzeugen, wobei das Verfahren Anderungen im Betriebsverhalten der Kompo- 
nenten und in der GroBe der Sensorfehler aus einer Reihe von Betriebsmessungen ableitet, wobei das 
Verfahren die folgenden Schritte umfaflt 
25 a) es wird eine a-priori-lnformation definiert, die fur ein Kalman-Filter erforderlich ist und folgende 

Bestandteile aufweist: 

i) eine Kovarianz-Matrix von BetriebsmeBanderungen der Korriponenten und Sensorfehler, 

ii) eine Messung einer nicht reproduzierbaren Kovarianz-Matrix, 

iii) eine System- Matrix, die eine Beziehung zwischen beobachteten Betriebsmessungsanderungen 
30 und Sensorfehlern liefert; 

b) es wird das Betriebsmeflsystem benutzt, urn Bezugswerte der Betriebsmessungen der Vorrich- 
tung zu erlangen; 

c) es wird das BetriebsmeBsystem benutzt, urn Betriebsmessungen von der Vorrichtung zu erhalten; 

d) es werden die Daten, die in den Schritten (b) und (c) erlangt wurden, benutzt, um BetriebsmeBdif- 
35 ferenzen von den Bezugswerten abzuleiten; 

e) es werden die in den Schritten (a) und (d) erlangten Daten benutzt, um eine hochstwahrscheinli- 
che Gruppe von Komponentenbetriebsanderungen und Sensorfehlern durch Benutzung eines Kal- 
man-Fi Iters abzuleiten; 

wobei das Verfahren durch die folgenden Schritte gekennzeichnet ist: 
40 f) es wird eine objektive Funktion berechnet, die ein MaB der Werte unerklarter BetriebsmeBande- 

rungen und/oder der Werte von KomponentenbetriebsmeBanderungen und Sensorfehlern in der 
Losung aus (e) liefert; 

g) es wird eine Oder es werden mehrere der Komponentenbetriebsanderungen und/oder Sensorfeh- 
ler ausgeschieden, um eine oder mehrere der Komponentenanderungen und/oder Sensorfehler zur 

45 Berechnung zu belassen; 

h) es werden die Schritte (e) bis (g) erforderlichenfalls wiederholt, bis die Gesamtzahl von Kompo- 
nentenbetriebsanderungen und Sensorfehlern, die verbleiben, Eins wird; und 

i) es werden die Gruppen berechneter Komponentenbetriebsanderungen und Sensorfehler, die bei 
jeder Wiederholung des Schrittes (e) erzeugt werden, zusammen mit der entsprechenden objektiven 

so Funktion betrachtet, die gemaB dem Schritt (f) berechnet wurde, um als bestes Ergebnis jene 

Wiederholung des Schrittes (e) zu identifizieren, die eine minimale Zahl von Komponentenbetriebs- 
anderungen und Sensorfehlern erzeugt hat, die in zufriedenstellender Weise zu den berechneten 
BetriebsmeBdifferenzen beitragen. 

55 2. Verfahren nach Anspruch 1, bei welchem die objektive Funktion dadurch berechnet wird, daB die 
Summe der Quadrate der unerklarten BetriebsmeBanderungen gebildet wird, gewichtet gemaB der 
Messung der nicht reproduzierbaren Kovarianz-Matrix. 
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3, Verfahren nach den AnsprUchen 1 cder 2, bet welchern die Komponentenbetriebsanderungen und 
Sensorfehler normalisiert werden, indem individuelle berechnete Komponentenbetrtebsanderungen und 
Sensorfehler durch die Quadratwur2eln der entsprechenden Diagonalelemente einer a-posteriori-Kovart- 
anz-Matrix geteilt werden, die am Ausgang des Kalman-Filters erzeugt wird. 

5 

4. Verfahren nach einem der Anspruche 1 bis 3, bei welchern in dem besten Ergebnis, welches wahrend 
des Schrittes (i) erzeugt wird, Komponentenbetriebsanderungen und/oder Sensorfehler, deren Werte 
kleiner sind a!s ein vorbestimmter niedriger Wert, ausgeschieden werden. 

10 5. Verfahren nach einem der Ansprilche 1 bis 4, bei welchern ein Durchschnitts-Absolutwert der normali- 
sierten Anderung nach einer ersten Wiederholung des Schrittes (e) berechnet wird und ein Bezugswert 
gebildet wird, urn Komponentenbetrtebsanderungen und/oder Sensorfehler auszuscheiden, bevor eine 
zweite derartige Wiederholung erfolgt. 

75 6. Verfahren nach einem der AnsprUche 1 bis 5, bei welchern am Ende der zweiten und jeder weiteren 
Wiederholung des Schrittes (e) Anderungen in den Absolutwerten der normalisierten Anderung relativ 
zu der vorhergehenden Wiederholung fUr jede der verbleibenden Komponentenbetriebsanderungen 
und/oder Sensorfehler berechnet und Bezugswerte gebildet werden, urn Komponentenbetriebsanderun- 
gen und/oder Sensorfehler auszuscheiden, bevor die nachste Wiederholung erfolgt. 

20 

7. Verfahren nach Anspruch 6, bei welchern Komponentenbetriebsanderungen und/oder Sensorfehler 
ausgeschieden werden, wenn sie kleiner sind als ihre entsprechenden Werte in dem vorherigen 
Durchlauf, wobei wenigstens die grofite Anderung oder der groBte Fehler aufrechterhalten wird und 
wenigstens die kleinsten Werte ausgeschieden werden. 

25 

8. Verfahren nach einem der Anspruche 1 bis 7, bei welchern a-priori-Werte fUr Elemente der Kovarianz- 
Matrix der Komponentenbetriebsanderungen und Sensorfehler berechnet werden und ein Produkt 
erzeugt wird mit (i) einer Kalman-Verstarker-Matrix des Kalman-Filters und (ii) mit der System- Matrix, 
urn ein MaB der Konfusion der gewunschten Komponentenbetriebsanderungen und/oder Sensorfehler 

30 mit anderen Anderungen und/oder Fehlern infolge der Abschatzungen zu berechnen, wobei diese 
Abschatzungen eingestellt werden, urn die Konfusion, die durch die Berechnung angezeigt wird, zu 
vermindern. 

9. Verfahren nach einem der Anspruche 1 bis 8, bei welchern eine a-priori-lnformation, die dem Kalman- 
35 Rlter zugefuhrt wird, eine beste Berechnung der Wirkungen der Matrizen von wenigstens einer der 

vorausgesagten Komponentenbetriebsanderungen und/oder Sensorfehlern aufweist. 

10. Verfahren nach einem der vorhergehenden Anspruche, bei welchern mehrere Gruppen von Betriebs- 
messungen in Zeitintervallen erlangt und benutzt werden, urn Pegel und/oder Trends und/oder Ande- 

40 rungen der vorausgesagten Werte der Komponentenbetriebsanderung und/oder Sensorfehler zu be- 
stimmen. 

11. Verfahren nach Anspruch 10, bei welchern die Gruppen von Betriebsmessungen fUr jene Pegel 
und/oder Trends analysiert werden und die sich aus der Analyse ergebenden Pegelwerte und/oder 

45 Trendwerte und/oder die Differenzen zwischen beobachteten und vorhergesagten Messungen dann 
einer Verarbeitung im Kalman-Filter unterworfen werden. 

12. Verfahren nach Anspruch 10, bei welchern die Gruppen von Betriebsmessungen einer Kalman-Filter- 
Verarbeitung unterworfen werden und die erlangten Werte dann im Hinblick auf Pegel und/oder Trends 

so und/oder Anderungen von vorausgesagten Werten von Komponentenbetriebsanderungen und/oder 
Sensorfehlern analysiert werden. 

Revendications 

55 1. Procede pour traiter des donnees relatives a la performance d'un appareil, Tappareil comprenant une 
plurality de composants dont les performances individuelles affectent la performance de I'appareil et 
une pluralite de capteurs pour fournir des entrees a un systeme de mesures de performance, les 
entrees des capteurs etant soumises a des biais qui produisent des erreurs dans la performance 
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mesuree de i'appareil, le proceed comprenant de determiner des changements de performance des 
composants et d'amplitude des biais de capteurs a partir de series de mesures de performance, le 
precede comprenant les etapes de : 

a/ definir une information a priori necessaire pour un filtre de Kalman, comprenant : 
5 i) une matrice de covariance des changements de performance des composants et des biais de 

capteur, 

ii) une matrice de covariance de non-repetatibilite de mesure, 

iii) une matrice syst&me qui fournit des relations entre des changements observes de mesure de 
performance et des biais de capteur ; 

w b/ utiliser le systSme de mesure de performance pour obtenir des niveaux de reference des 

mesures de performance de Pappareil, 

d utiliser le systeme de mesure de performance pour obtenir des mesures de performance de 
rappareil, 

d/ utiliser les donn£es obtenues dans les Stapes b/ et c/ pour deduire des differences de mesure de 
is performance a partir des niveaux de reference, 

e/ utiliser les donnees obtenues dans les etapes a/ et d/ pour deduire un ensemble le plus probable 
de changements de performances des composants et de biais de capteur en employant un filtre 
Kalman, 

le procede etant caract§ris£ par les Stapes suppiementaires de : 
20 V evaluer une fonction objective donnant une mesure de la valeur de changement de mesure de 

performance inexplique et/ou les valeurs de changement de mesure de performance des compo- 
sants et de biais de capteur dans la solution issue de e/, 

g/ eliminer un ou plusieurs des changements de performance des composants et/ou des biais de 
capteur, pour laisser un ou plusieurs desdits changements de composants et/ou biais de capteur 
25 pour evaluation, 

h/ repeter les etapes e/ a g/ si necessaire, jusqu'a ce que le nombre total restant de changements 
de performance des composants et de biais de capteur soit un ; et 

i/ considerer les ensembles de changements de performance des composants et de biais de capteur 
estim^s, produits dans chaque repetition de retape e/, ainsi que la fonction objective correspondante 
30 evaluee selon retape f/ pour identifier comme meilleur r£sultat la repetition de retape e/ qui a 

produit un nombre minimum de changements de performance des composants et de biais de 
capteur qui rend compte de fagon satisfaisante des differences de mesure de performances 
calcuiees. 

35 2. Procede selon la revendication 1 , dans lequel la fonction objective est evaluee en deduisant la somme 
des carres des changements de mesure de performance inexpliquee, ponderee selon la matrice de 
covariance de non-repetatibilite de mesure. 

3. Procede selon la revendication 1 ou la revendication 2, dans lequel les changements de performance 
40 des composants et les biais de capteurs sont normalises en divisant les changements de performance 
des composants et les biais de capteur individuels estimes par les racines carrees des elements 
diagonaux correspondents d'une matrice de covariance a posteriori produit comme sortie du filtre de 
Kalman. 

45 4. Procede selon Tune quelconque des revendication s t a 3, dans lequel dans le meilleur resultat identifie 
dans retape i/, les changements de performance des composants et/ou les biais de capteur dont les 
valeurs sont interieures a un niveau inferieur predetermine sont eiiminees. 

5. Procede selon les revendications 1 a 4, dans lequel la valeur moyenne absolue de changements 
so normalisees est evaluee apres une premiere repetition de retape e/ et fournit une valeur de reference 

pour eliminer les changements de performance des composants et/ou les biais de capteur avant une 
telle seconde repetition. 

6. Procede selon les revendications 1 a 5, dans lequel a la fin de la seconde repetition et de chaque 
55 repetition ulterieure de retape e/, des changements dans les valeurs absolues de changements 

normalisees par rapport a la repetition precedente sont evaluees pour chacun des changements de 
performance des composants et/ou des biais de capteurs restant et fournissent des valeurs de 
reference pour eliminer des changements de performance des composants et/ou des biais de capteurs 
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avant la prochaine repetition. 

7. Precede selon ia revendication 6, dans lequel des changements de performance des composants et/ou 
des biais de capteurs sont elimines si ils sont inferieurs h lours valeurs correspondantes dans (edit 

5 precedent passage, sous reserve d'au moins le plus grand dudit changernent ou biais qui est retenu et 
d'au moins le plus petit dudit changernent ou biais qui est elimine. 

8. Procede selon les revendication s 1 h 7, dans leque) des valeurs a priori pour des elements de la 
matrice de covariance des changements de performance des composants et des biais de capteur sont 

ro estimees et un produit est forme avec i) une Matrice Gain de Kalman du filtre de Kalman et ii) la 
Matrice Systeme, pour evaluer une mesure de confusion des changements de performance des 
composants et/ou des biais de capteur d6sir6s avec d'autres changements et/ou biais en raison 
desdites estimations et lesdites estimations sont ajustees pour require la confusion indiquee par ladite 
Evaluation. 

75 

9. Procede selon les revendications 1 a 8 t dans lequel une information a priori envoyde au filtre de 
Kalman comprend une stimulation optimum des effets sur les matrices d'au moins un changernent de 
performance des composants et/ou un biais de capteur anticipe\ 

20 10. Procede selon Tune quelconque des revendications prdcedentes, dans lequel une pluralite d'ensembles 
de mesures de perfomance sont obtenus h intervalies et employes pour determiner des niveaux et/ou 
des tendances et/ou des variations h partir de valeurs anticipees de changements de performance des 
composants et/ou de biais de capteur. 

25 11. Procede selon la revendication 10, dans lequel lesdits ensembles de mesures de performance sont 
analyses pour lesdits niveaux et/ou tendances, et les valeurs de niveau et/ou les valeurs de tendance 
et/ou les differences entre les mesures observers et anticipees qui sont obtenues & partir de ladite 
analyse sont ensuite soumises I un traitement par filtre de Kalman. 

30 12. Procede* selon la revendication 10, dans lequel lesdits ensembles de mesure de performance sont 
soumis a un traitement par filtre de Kalman et les valeurs obtenues sont ensuite analysees pour des 
niveaux et/ou des tendances et/ou des variations h partir de valeurs anticipees de changements de 
performance des composants et/ou de biais de capteur. 
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Fig. 1. 
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